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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re Application of Atty. Docket 
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Honorable Coininissioner of Patents and Trademarks 
Washington, D.C. 20231 

PRELIMINARY AMENDMENT 

Sir: 

Prior to calculation of the filing fee and examination, please 
amend the above- identified application as follows: 



IN THE SPECIFICATION 
Page 1, before line 1, insert the following heading: 

--BACKGROUND OF THE INVENTION--; 
Page 2, before line 6, insert the following heading: 

--SUMMARY OF THE INVENTION--; 
Page 5, before line 1, insert the following heading: 

--BRIEF DESCRIPTION OF THE DRAWINGS--; 
Page 5, before line 22, insert the following heading: 

--DESCRIPTION OF THE PREFERRED EMBODIMENTS--. 



IN THE CLAIMS 
Please cancel claims 10 and 12 . 
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Please add new claims 13-21 as follows: 



13. An apparatus for playing out a coded presentation comprising: 

a presentation element adapted to be is played out according to 
a play-out specification 

a sub-presentation comprising an interface configured to 
provide a reference, wherein the presentation element is further 
adapted to be played out relative to the reference. 

14. An information carrier comprising a coded presentation, said 
coded presentation comprising: 

at least one presentation element; and 

a play-out specification of the presentation element indicating 
how the presentation element is to be played out, wherein the coded 
presentation comprises a sub-presentation which comprises the 
presentation element, and wherein the sub-presentation is provided 
with an interface providing a reference for the play-out 
specification of the presentation element. 

15. The information carrier of claim 14, wherein the sub- 
presentation comprises a sequence of presentation elements which 
are to be presented one after the other. 

16. The information carrier of claim 14, wherein the sub- 
presentation comprises a group of presentation elements which are 
to be presented simultaneously with respect to each other. 
S:\TH\PB2 8THA0.BDR 2 



17. The information carrier of claim 14, wherein the play-out 
specification includes a timing specification specifying timing 
behavior of the presentation element and wherein the interface of 
the sub-presentation provides a time reference relative to which 
the timing specification for the presentation element is specified. 

18. The information carrier of claim 11, wherein the timing 
specification specifies the start of the presentation element with 
respect to the time reference of the sub-presentation. 

19. The information carrier of claim 17, wherein the timing 
specification specifies the duration of the presentation element 
with respect to the time reference of the sub-presentation. 

20. The information carrier of claim 14, wherein the play-out 
specification includes a location specification specifying a 
location of the presentation element when presented and wherein the 
interface of the sub-presentation provides a location frame of 
reference relative to which the location specification for the 
presentation element is specified. 

21. The information carrier of claim 14, wherein the interface of 
the sub-presentation provides a sub-presentation priority 
specifying a priority with respect to presenting the sub- 
presentation . 
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IN THE ABSTRACT 

Page 11, delete in its entirety and substitute the following 
new Abstract : 
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--ABSTRACT OF THE DISCLOSURE 
A coded presentation comprises a number of sub- 
presentations, each comprising a number of presentation 
elements. A presentation element is an elementary part 
that is to be presented and comprises text, audio, video 
or an image. A sub-presentation has an interface that 
provides a reference for the presentation elements in that 
sub-presentation. This reference can relate to timing 
aspects and to locations aspects relevant during play out, 
and to a priority as to whether or not the sub- 
presentation is to be played out.--. 
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REMARKS 

This Preliminary Amendment is submitted to place the 
application in proper U.S. format and to delete multiple 
dependencies in the claims. Entry is respectfully requested. 

Respectfully submitted. 



By vw.^<^^ 

Gregory L. #10: 
Attorney 
(914) 333-9665 
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Method for coding a presentation. 



The invention relates to a method for coding a presentation, the coded 
presentation comprising at least one presentation element and a play-out specification of the 
presentation element indicating how the presentation element is to be played out. 

The invention further relates to a method for playing out a coded presentation 
5 comprising at least one presentation element, in which method the presentation element is 
played out according to a play-out specification. 

The invention further relates to an apparatus for playing out a coded 
presentation, coded according to the above method for coding a presentation. 

The invention further relates to an apparatus comprising a converter module for 
1 0 amending a coded presentation, the coded presentation comprising: 
at least one presentation element, and 
a play-out specification of the presentation element. 
The invention further relates to an information carrier comprising a coded 
presentation, which is coded according to the above method for coding a presentation. 
15 It is known to code a presentation into a description according to a given 

format. The coded presentation may be transferred via a network or stored in a memory 
medium for subsequent play out by a suitable apparatus. An example of such a format is the 
ISO/IEC standard IS 13522-5, better known as MHEG. This standard is described in the 
document "ISO/IEC International Standard IS 13522-5 (MHEG) Information Technology - 
20 Coding of multimedia and hypermedia information, Part 5: Support for base-level interactive 
applications", November 1996. The presentation may include presentation elements 
comprising text, audio, video or an image. A presentation element can be regarded as an 
elementary item that is to be presented. In MHEG, a presentation element is called a 
Presentable. The coded presentation may include a play-out specification for the play out of a 
25 given presentation element. An example in MHEG is where a presentation element somewhere 
in the presentation may cause the start of another presentation element somewhere else in the 
presentation. This event-action mechanism provides the author of the presentation with control 
over the timing of the various presentation elements. So, during play out of a coded 
presentation, a specific presentation element may be triggered by a running presentation 
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element and the timing behaviour of said specific presentation element is determined on the 
basis of the direct relation between the running presentation element and that specific 
presentation element. This causes the problem that the presentation must be executed 
integrally and that it is very cumbersome to remove a presentation element or substitute it by 
5 another one. 

It is an object of the invention to provide a method for coding a presentation of 
the kind set forth in the opening paragraph, in which the description of the play-out 
specification is improved. This object is achieved according to the invention in a method that 
is characterised in that the coded presentation comprises a sub-presentation which comprises 

10 the presentation element, and that the sub-presentation is provided with an interface providing 
a reference for the play-out specification of the presentation element. By grouping the 
presentation elements into respective sub-presentations, the coded presentation is given an 
explicit structure which makes it easier to handle it, e.g. to play out the coded presentation. By 
providmg a reference for the play-out specification of its constituting presentation elements, 

1 5 the sub-presentation becomes a self-contained entity with respect to play out. The sub- 
presentation may be played out autonomously without there being a need to consult other sub- 
presentations in the presentation. Furthermore, the sub-presentation may be substituted by 
another sub-presentation having the same interface as far as the provided reference is 
concerned. The content and the behaviour of the substituted sub-presentation may differ from 

20 the content and the behaviour of the original sub-presentation as long as they interact with 
their environment in the presentation, i.e. through the definition of their respective interfaces, 
in mutually the same way. Organising the coded presentation into sub-presentations, results in 
a coded presentation that is simpler to process, e.g. for playback, because the processing 
apparatus does not need to interpret the whole presentation prior to handling a sub- 

25 presentation. This means tiiat the processing apparatus, which may be a consumer playback 
apparatus, can be designed with a smaller processor and a smaller working memory. At the 
level of the coded presentation, it is not necessary to know the play-out specification of the 
various presentation elements. This knowledge can now be specified at the level of the sub- 
presentation which comprises the particular presentation element. 

30 An embodiment of the method according to the invention is defined in Claim 4. 

By providing the sub-presentation with an interface providing a time reference, tiie tuning 
specification of its presentation elements may be made relative to that interface. Doing so 
offers the advantage that the sub-presentation has become a self-contained entity as far the 
timing behaviour is concerned. The timing issues of the presentation elements can be resolved 
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internally, i.e. without reference to other presentation elements outside the sub-presentation. 
This means that substituting or removing a presentation element is a relatively easy process 
because it is not necessary to check the whole of the presentation for broken relations and 
timing inconsistencies. Furthermore, a sub-presentation may be substituted by another sub- 
5 presentation according to the invention, provided that the interface of the two sub- 
presentations is the same. Also, since the sub-presentation is a self-contained entity, the sub- 
presentation may be individually played out, separate from the rest of the presentation. This is 
useful when only a fragment of the presentation is needed or when a part of the presentation is 
to be verified. 

1 0 An embodiment of the method according to the invention is defined in Claim 5. 

The start of the presentation element is one of the aspects of the timing behaviour that can be 
advantageously specified relative to the time reference of the sub-presentation. Apart from the 
timing specification relative to the time reference, a presentation element may have a further 
timing specification that is specified relative to another presentation element within the same 

1 5 sub-presentation. For example, the start of a presentation element is specified relative to the 
time reference of the sub-presentation and the end of that presentation element is specified 
relative to another presentation element in the sub-presentation. 

An embodiment of the method according to the invention is defined in Claim 7. 
By providing a location frame of reference via the interface of the sub-presentation, the 

20 location specification of the presentation elements of the sub-presentation may be made 
relative to that location frame of reference. Then the sub-presentation has become a self- 
contained entity as far the locations of the presentation elements are concerned. The location 
issues of the presentation elements can be resolved internally, i.e. without referring to other 
presentation elements outside the sub-presentation. The location issues concern for example 

25 the layered organisation of the presentation elements on a display. To reconstruct which 
presentation element is to be displayed in front of which other presentation element, their 
relative layering must be known. Another example is the specification of the window in which 
the presentation elements are to be displayed. 

An embodiment of the method according to the invention is defined in Claim 8. 

30 By providing the priority for presenting the presentation elements via the interface, the priority 
is established for the sub-presentation as a whole. In this way, it can be decided during play 
out whether or not the sub-presentation is to be played out in view of its priority. This is 
particularly advantageous for play out on a minimal resource platform, i.e. a platform with 
small processing capacity and a small working memory. If such a platform is not able to 
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completely process the presentation, it can now skip the sub-presentation with the lowest 
priority. An author preparing a presentation may actively use this priority encoding 
mechanism to create a presentation that is suitable to be played out on various types of 
apparatus, each according to its own capabilities. The author assigns to the more important 
5 sub-presentations a high priority and to the less important ones a lower priority. A powerful 
apparatus will play out all sub-presentations whereas a smaller apparatus will skip the sub- 
presentations that are indicated to be less important. 

It is a fiirther object of the invention to provide a method for playing out a 
coded presentation of the kind set forth with an improved mechanism for determining the 

1 0 play-out specification of a presentation element. This object is achieved according to the 
invention in a method that is characterised in that that the presentation comprises a sub- 
presentation which comprises the presentation element, that the sub-presentation comprises an 
interface providing a reference, and that the presentation element is played out according to 
the play-out specification relative to this reference. The interface of the sub-presentation 

1 5 provides a reference for the presentation elements in the sub-presentation. This causes the sub- 
presentation to be self-contained with respect to the behaviour of the presentation elements, 
and during play out all relations can be resolved internally to the sub-presentation. There is no 
need to refer to presentation elements outside the currently played out sub-presentation and 
this greatly facihtates the play out process. 

20 It is a further object of the invention to provide an apparatus comprising a 

converter module of the kind set forth with an improved mechanism for substituting a sub- 
presentation. This object is achieved according to the invention in an apparatus that is 
characterised in that that the coded presentation comprises a sub-presentation which comprises 
the presentation element, that the sub-presentation comprises an interface providing a 

25 reference for the play-out specification of the presentation element, and that the converter 

module is arranged to substitute the sub-presentation by a further sub-presentation comprising 
a corresponding interface. This apparatus allows easy substitution of a specific sub- 
presentation with a sub-presentation comprising a corresponding interface. This can 
advantageously be used for amending a coded presentation with text presentation elements in 

30 one language into a new coded presentation with these text presentation elements in another 
language. 

Fiuther advantageous embodiments of the invention are recited in the 
dependent claims. 
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The invention and its attendant advantages will be further elucidated with the 
aid of exemplary embodiments and the accompanying schematic drawings, wherein: 
Figure 1 schematically shows the environment in which the invention is 

executed, 

5 Figure 2 schematically shows the organisation of presentation elements in a 

coded presentation according to the prior art, 

Figure 3 schematically shows the organisation of presentation elements 
according to the invention, 

Figure 4 shows an example of a presentation comprising an audio element and 
1 0 three textual elements, 

Figure 5 shows an example of a presentation comprising two video elements 
and four textual elements. 

Figure 6 shows the example of Figure 5 with modified frames for the sub- 
presentations, 

1 5 Figure 7 shows an example of a presentation with images on multiple layers, 

and 

Figure 8 shows the most important components of the apparatus for playing out 
a coded presentation according to the invention. 

Corresponding features in the various Figures are denoted by the same 
20 reference symbols. 

Figure 1 schematically shows the environment in which the invention is 
executed. An author 102 uses a preparation system 104 to prepare a presentation. The 
presentation may include text, images, audio and video, which is combined according to the 

25 specification of the author. The preparation system 104 generates a coded presentation 106 
according to a certain format. The coded presentation 106 is also referred to as a multimedia 
document, since it may contain a number of different media types. The coded presentation 106 
may be stored on an information carrier 108 for subsequent play out and distribution to users. 
The information carrier may be a CD-ROM, magnetic disk, tape or the Hke. A user 110 

30 retrieves through a playback apparatus 112 a copy 1 14 of the presentation from a local copy 
116 of the information carrier. If the playback apparatus is not suitable for playback of a 
presentation in the format used, then a converter may be provided that converts the local copy 
1 14 of the presentation into a format that can be handled by the playback apparatus. Instead of 
storing the coded presentation 106 on an information carrier, the coded presentation may be 
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stored on the storage device 1 1 8 of a server 120. A user 122 may subsequently access the 
server via a network 124 to play out the presentation on a local station 126. An example of this 
latter alternative is the use of HTML pages forming a presentation which is put on a server and 
later accessed by a user via the Internet network. 
5 Figure 2 schematically shows the organisation of presentation elements in a 

coded presentation according to the prior art. A coded presentation 202 comprises a number of 
presentation elements, of which are shown presentation elements 204, 206, 208, 210, 212 and 
214. A presentation element is an elementary part of the presentation, like a still image or a 
piece of text, which at a given moment is presented in the presentation. Presentation element 

10 204 comprises an event 216 that triggers the play out of presentation element 208 and 

presentation element 206 comprises an event 218 that triggers the play out of presentation 
element 214. Presentation element 212 comprises an event 220 that also triggers the play out 
of presentation element 214. When a presentation element is running, i.e. being played out at a 
certain moment its event is executed which causes the play out of another presentation element 

1 5 to start. The newly started presentation element may be presented in addition to the original 
one, e.g. when a certain point in an audio presentation has been reached the display of an 
image is started, or it may substitute the original one, e.g. displaying a new image replacing a 
previously displayed image. Altemative descriptions for this event-action mechanism are 
synchronisation arc, sync arc and timing specification. According to the prior art, a 

20 presentation element may be triggered from anywhere in the presentation and by different 
presentation elements. 

Figure 3 schematically shows the organisation of presentation elements 
according to the invention. A coded presentation 302 comprises a sub-presentation 304 and a 
sub-presentation 306. The sub-presentation 304 comprises presentation elements 308, 310 and 

25 312, and sub-presentation 3 06 comprises presentation elements 314,316 and 317. 

Sub-presentation 304 comprises an interface 318 which provides a time 
reference for the whole of the sub-presentation 304. This time reference may provide a point 
in time from which the starting and end times of presentation elements can be scheduled and it 
may provide a clock for synchronising the pace of presenting the presentation elements for a 

30 specified duration. The timing specification for presentation elements 308, 310 and 312 is 
specified relative to the time reference of the interface 318. The interface 318 of sub- 
presentation 304 provides a translation between the time reference valid for the enclosing 
presentation 302 and the elements of the sub-presentation 304. Sub-presentation 306 has its 
own interface 320 providing a time reference for that sub-presentation. The timing 
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specification for a presentation element need not be directly related to the interface. 
Presentation element 317 is specified relative to an event of presentation element 316 of the 
same sub-presentation. For example, is that presentation element 317 is started when 
presentation element 316 ends. Furthermore, different aspects of the timing specification may 
5 be specified relative to different events. Presentation element 3 16 is specified for one aspect 
relative to the interface 320 of the sub-presentation and for another aspect relative to event 322 
of presentation element 314. For example, the starting time of presentation element 316 is 
given relative to the interface 320 and the end time of presentation element 316 is given 
relative to the event 322 in presentation element 314. However, although in both cases the 

1 0 timing specification is not specified in direct relation to the interface, it is still given within the 
scope of sub-presentation 306. So all timing issues, such as the start of a presentation element 
or the verification of the timing in a sub-presentation, can be resolved by merely consulting 
the sub-presentation and the presentation elements included therein. There is no need to take 
into account other presentation elements in other sub-presentations. Because of this 

15 organisation of the timing specifications, a sub-presentation can be played out separately firom 
the rest of the presentation. This may be usefiil for testing purposes when certain small 
changes have been made to the presentation, and it would take excessively long to play out the 
whole presentation. Furthermore, this organisation allows a complete sub-presentation to be 
substituted by another as long as the new one has an interface which is compatible with the 

20 original one. 

A sub-presentation has a structural meaning in that it describes the structure of 
the presentation in groups of presentation elements. A sub-presentation can further have 
scheduling information as to the timing of the play out of the presentation elements. The 
interface of the sub-presentation provides for communication regarding the play-out 

25 specification, i.e. the start of a sub-presentation passes information via the interface into the 
sub-presentation for the play out of the presentation elements. The communication may also 
be firom inside the sub-presentation to the outside of the sub-presentation, i.e. to the enclosing 
(sub-)presentation. An example is the export of a clock triggered by a presentation element. 

Figure 4 shows an example of a presentation comprising an audio element and 

30 three textual elements. Presentation 400 comprises the simultaneous presentation of a 

presentation element 402 called audio 1 and a series of three presentation elements 404, 406 
and 408, called txtl, txt2 and txt3, respectively. The presentation of the series starts with the 
presentation of presentation element 404, followed by the presentation of presentation element 
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406 and ends with the presentation of presentation element 408. In an embodiment of the 
invention, presentation 400 is coded as follows: 

(1) 
5 (2) 
(3) 

(4) <par> 

(5) <audio id = "audior'> 

(6) <seq clock = "audio 1"> 

10 (7) <text id = "txtl" begin = "0"> 

(8) <text id = "txt2" begin = "10s"> 

(9) <text id = "txt3" begin = "20s"> 

(10) </seq> 

(1 1) </par> 
15 (12) 

(13) 
(14) 

Lines 1-3 symbolise that various lines of the coded presentation have been omitted from the 
20 example and that only the part corresponding to Figure 4 has been given. Line 4 defines the 
beginning of a so-called parallel sub-presentation of sub-presentations and/or presentation 
elements which are to be presented in parallel, i.e. simultaneously. Line 1 1 defines the end of 
that parallel sub-presentation. The parallel sub-presentation of this example contains two parts 
that are to be presented simultaneously. These are a presentation element defined in line 5 and 
25 a sequential sub-presentation defined in lines 6-10. A sequential sub-presentation comprises 
sub-presentations and/or presentation elements that are to be presented sequentially, i.e. one 
after the other. The sequential sub-presentation of this example comprises three presentation 
elements each comprising a text, called txtl, txt2 and txt3, respectively. The presentation 
element of the parallel sub-presentation comprises an audio piece called audio 1, as defined in 
30 line 5. Now, in order to define the instant that a particular presentation element of the 

sequential sub-presentation is to be presented, each such presentation element is given a 
starting time. In the example, the starting time is 0, 10 and 20 seconds, respectively. In the 
context of the sequential sub-presentation, the start of a textual presentation element impHes 
the end of the preceding textual presentation element. According to the invention, the starting 
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times of the presentation elements are given relative to the time reference of the enclosing sub- 
presentation. In line 6, the interface of the sequential sub-presentation specifies that the time 
reference corresponds to the time reference of the presentation element audio 1. This means 
that the presentation of txtl starts at the same time as the presentation of audiol. The timing 
specifications of the presentation elements for txtl, txt2 and txt3 are specified with respect to 
the interface of the sequential sub-presentation and do not themselves refer directly to the 
presentation element audiol. This is an important aspect because it ensures that the timing 
issues of the sequential sub-presentation defined in lines 6-10 can be resolved internally and 
that no reference outside the sub-presentation need be verified. 

An alternative to a coded presentation for the presentation 400 is the following: 

(1) 
(2) 
(3) 

(4) <par> 

(5) <audio id = "audio 1"> 

(6) <seq clock = "audio 1"> 

(7) <text id -"txtl" dur = "10s"> 

(8) <text id = "txt2" dur=="10s"> 

(9) <text id-"txt3" dur = "10s"> 

(10) </seq> 

(11) </par> 
(12) 

(13) 
(14) 



In this example, the duration of the period during which the textual presentation elements must 
be presented is specified. The first textual presentation element starts immediately after the 
start of the sequential sub-presentation, i.e. at the same time as the start of the audio 
30 presentation element, and continues for 10 seconds. Then the second textual presentation 
element is started, because they are in a sequential sub-presentation which indicates that the 
presentation elements must be presented sequentially. The duration of the textual presentation 
elements is given with respect to the time reference of the interface defined in line 6. When 
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this alternative is played out, the result is the same as that of the previous alternative where the 
starting times of the textual attributes have been specified. 

Figure 5 shows an example of a presentation comprising two video elements 
and four textual elements. Presentation 500 comprises the simultaneous display of a video sub- 
5 presentation 502 and a textual sub-presentation 504. The video sub-presentation 502 

comprises a sequence of video presentation element 504, called video 1, and video presentation 
element 506, called video2. The textual sub-presentation 504 comprises a sequence of textual 
presentation element 508, called txtl, textual presentation element 510, called txt2, textual 
presentation element 512, called txt3, and textual presentation element 514, called txt4. The 
1 0 coded presentation corresponding to presentation 500 is: 



(1) 
(2) 
(3) 

15 (4) <par> 

(5) <seq id = "seql" export clock x_origin = "30" y_origin = "0"> 

(6) <video id = "videor'> 

(7) <video id = "video2"> 

(8) </seq> 

20 (9) <seq id = "seq2" clock = "seql" x_origin = "30" y_origin=" 80"> 

(10) <text id = "txtl" dur = "10s"> 

(11) <text id = "txt2" dur = "10s"> 

(12) <text id = "txt3" dur = "10s"> 

(13) <text id = "txt4" dur = "10s"> 
25 (14) </seq> 

(15) </par> 

(16) 

(17) 

(18) 

30 

The coded presentation comprises a parallel sub-presentation of a sequential video sub- 
presentation seql, defined in lines 5-8, and a sequential textual sub-presentation seq2, defined 
in lines 9-14. The sub-presentation seql has a time reference according to which its 
presentation elements video 1 and video2 are presented. This time reference is available inside 
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sub-presentation seql, but through the interface defined in line 9 it becomes also available to 
the enclosing parallel sub-presentation. According to the timing interface of sub-presentation 
seq2, which is defined in line 9, the time reference exported by seql is to be used inside seq2. 
So the duration of the textual presentation elements of lines 10-13 is synchronised with the 
5 presentation of the video presentation elements. 

Figure 5 further shows a display area 516, comprising a frame 518 in which the 
video presentation elements are to be presented and a frame 520 in which the text presentation 
elements are to be presented. These frames are defmed in the interface of the respective sub- 
presentation. For reasons of brevity, only the definition of the origins of the frames has been 
1 0 expUcitly mentioned in the code presentation above: the origin of the frame 5 1 8 in line 5 and 
the origin of frame 520 in line 9. In this example, a sub-presentation has an interface providing 
a time reference for its presentation elements and providing a location frame of reference for 
its presentation elements. Botii types of reference cause the sub-presentation to be a self- 
contained entity that is isolated from the other parts of the coded presentation. As described 
1 5 hereabove, this facilitates the maintenance of a presentation, because substitiition of sub- 
presentations can be executed more easily, and it also facilitates the play out of the 
presentation, also allowing a separate play out of a sub-presentation. 

Figure 6 shows the example of Figure 5 with modified frames for the sub- 
presentations. The stinicture of the sub-presentations and their presentation elements are the 
20 same as in the previous example. Here, display area 602 comprises a frame 604 in which the 
video presentation elements are to be presented and a frame 606 in which the text presentation 
elements are to be presented. The coded presentation is as follows: 



(1) 

25 (2) 
(3) 

(4) <par> 

(5) <seq id = "seql" export clock x_origin = "0" y_origin = "0" 

(6) <video id = "video 1"> 
30 (7) <video id = "video2"> 

(8) </seq> 

(9) <seq id = "seq2" clock = "seql" x_origin = "0" y_origin = 

(10) <text id = "txtr' dur = "10s"> 

(11) <text id = "txt2" dur = "10s"> 
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(12) <text id = "txt3" dur-"10s"> 

(13) <text id = "txt4" dur = "10s"> 

(14) </seq> 

(15) </par> 
(16) 

(17) 
(18) 



This coded presentation results in the same presentation as the previous one, but in somewhat 
1 0 larger frames. Such difference in frames could be used to prepare a presentation for a TV 
screen with a traditional aspect ratio of 4:3 and a presentation for a wide-screen TV with an 
aspect ratio of 16:9. The following coded presentation is useful in particular for that purpose: 



(1) 

15 (2) 
(3) 

(4) <par x_origin = "0" y_origin = "0"> 

(5) <seq id = "seql" export clock> 

(6) <video id = "video r'> 
20 (7) <video id = "video2"> 

(8) </seq> 

(9) <seq id=="seq2" clock = "seql" y_origin = "80"> 

(10) <text id = "txtl" dur = "10s"> 

(11) <text id = "txt2" dur = "10s"> 
25 (12) <text id = "txt3" dur = "10s"> 

(13) <text id = "txt4" dur = "10s"> 

(14) </seq> 

(15) </par> 
(16) 

30 (17) 
(18) 
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The x_origm defined in line 4 is valid for the whole parallel sub-presentation. This means that 
changing from wide-screen, as in the coded presentation above, to traditional screen requires 
only amending line 4 to: 

(4) <par x_origin = "30" y_origin = "0"> 

Then the whole presentation starts at an offset of 30. 

Figure 7 shows an example of a presentation with images on multiple layers. 
The presentation 700 comprises a background image bck on which all other images are 
displayed. Furthermore the image comprises a front image fr which is always on top of the 
other images. Such front image could be used for markers, frame lines, subtitles and the like. 
The presentation ftirther comprises images iml, un2 and im3, with the following rules for 
visibility: iml will be on top of im2 and im3, and im2 will be on top of im3. This organisation 
of images in various layers is achieved in the following coded presentation: 

(1) 
(2) 
(3) 

(4) <par> 

(5) <img id = "fr" layer = "3"> 

(6) <par layer ="2"> 

(7) <img id = "iml" layer = "5"> 

(8) <img id = "im2" layer = "3"> 

(9) <img id = "im3" layer = "!"> 

(10) </par> 

(11) <img id = "bck" layer = "r'> 

(12) </par> 
(13) 

(14) 
(15) 



In the coded presentation, the number of a layer determines which layer is on top of which 
other layer and consequently which layer is visible at the expense of another. A higher layer 
number is displayed in front of a lower layer number. The example comprises a parallel sub- 
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presentation defined in lines 4-12, comprising image fr at layer 3, a parallel sub-presentation 
of images at layer 2 and image bck at layer 1. This means that image fr is always on top of 
other images, that image bck is at the back of other images and that the group of images of the 
sub-presentation is between fr and bck. The parallel sub-presentation of images is defined in 
5 lines 6-10 and comprises image iml at layer 5, image im2 at layer 3 and image iml at layer 1. 
It is to be noted that these layer numbers refer to the frame of reference of the sub- 
presentation, which frame is not available outside the sub-presentation. So the layer numbers 
indicate the relative position of layers within the sub-presentation, which itself resides at the 
level of the presentation at layer 2. So, image iml having local layer number 5 is not on top of 

1 0 image fr having layer number 3 simply because from the perspective of image fr all images of 
the sub-presentation reside on layer 2. The local layer number is not available at the level of 
the presentation and cannot be compared with the layer niraiber of image fr. 

The examples given refer to a coded presentation with sub-presentations which 
have an interface providing a time and/or a location frame of reference according to the 

15 invention. Sub-presentations may be nested, i.e. a sub-presentation may include another sub- 
presentation, whereby the included sub-presentation also has such a timing and/or location 
interface. The concept of interface may also be extended to the coded presentation as a whole. 
The timing aspects and the location aspects of such a coded presentation are then frilly 
described in the interface. This makes it possible to substitute one coded presentation with 

20 another, provided that the interfaces are the same. Furthermore, it is possible then to treat the 
coded presentation as a sub-presentation and to include a coded presentation in another coded 
presentation. This may be used for dividing the presentation into two sub-presentations and to 
offer the user a choice as to which sub-presentation must be played out. Offering this choice 
may be implemented as presenting the user two still images, representing the respective sub- 

25 presentations. A selection by the user of one of the images results in play out of the 
corresponding sub-presentation. Additionally, the absence of a user selection during a 
predetermined time may result in the sequential play out of the sub-presentations. Note that 
the, in this example two, sub-presentations relate to each other as one sub-presentation being 
contained by the other, sub-presentation. The part of the one sub-presentation is not played out 

30 if the user/machine selects the other sub-presentation. 

Figure 8 shows the most important components of the apparatus for playing out 
a coded presentation according to the invention. The apparatus 800 is implemented according 
to known architecture and can be realized on a general purpose computer. The apparatus has a 
processor 802 for carrying out instructions from an application program loaded into working 
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memory 804. The apparatus further has an interface 806 for communication with peripheral 
devices. There is a bus 808 for exchange of commands and data between the various 
components of the apparatus. The peripherals of the apparatus include a storage medium 810 
containing the executable programs, the coded presentation if this is distributed via a local 
5 carrier, and various other data. The storage medium 810 can be embodied so as to include 
various separate devices which, potentially, may be different kinds of storage devices. 
Application of the invention is not restricted by the type of device, and storage devices which 
can be used include optical discs, magnetic discs, tapes, chip cards, solid state devices or some 
combination of these devices. Furthermore, the apparatus may be coimected to a remote server 

10 by a network via connection 812. The peripherals of the apparatus further include a display 

814, on which the system displays inter alia the visual presentation elements, and speakers 816 
for presenting the audible presentation elements. Furthermore, the peripherals may include a 
selection device 818 and a pointing device 820 with which the user can move a cursor on the 
display. Devices 818 and 820 can be integrated into one selecting means 822, such as a 

15 computer mouse with one or more selection buttons. However, other devices, such as a track 
ball, graphic tablet, joystick, or touch-sensitive display are also possible. In order to carry out 
the various tasks, the respective software modules are loaded into the working memory 804. 

The apparatus may be provided with a converter module 824 that is capable of 
substituting one specific sub-presentation with a predetermined sub-presentation. Apart from 

20 being incorporated in the playback apparatus, the converter module may be implemented in a 
stand-alone apparatus whose only function is to substitute the sub-presentation. The 
substitution may be executed off-line on the coded presentation stored in the storage medium. 
The result is either the modified coded presentation or a new copy of the presentation 
containing the amendment. The substitution may also be executed real-time, while the coded 

25 presentation is being played out. In this case, the converter apparatus receives the original 
coded presentation, either from a storage medium or from a network, and outputs a coded 
presentation containing the amendment. So the converter apparatus may produce as output a 
coded presentation described in the same format as the coded presentation that the apparatus 
received as input. 
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1 . A method for coding a presentation, the coded presentation comprising at least 
one presentation element and a play-out specification of the presentation element indicating 
how the presentation element is to be played out, characterized in 

that the coded presentation comprises a sub-presentation which comprises the presentation 
5 element, and 

that the sub-presentation is provided with an interface providing a reference for the play-out 
specification of the presentation element. 

2. A method according to Claim 1, wherein the sub-presentation comprises a 
10 sequence of presentation elements which are to be presented one after the other. 

3. A method according to Claim 1, wherein the sub-presentation comprises a 
group of presentation elements which are to be presented simultaneously with respect to each 
other. 

15 

4. A method according to Claim 1 wherein the play-out specification includes a 
timing specification specifying timing behavior of the presentation element and wherein the 
interface of the sub-presentation provides a time reference relative to which the timing 
specification for the presentation element is specified. 

20 

5. A method according to Claim 4, wherein the timing specification specifies the 
start of the presentation element with respect to the time reference of the sub-presentation. 

6. A method according to Claim 4, wherein the timing specification specifies the 
25 duration of the presentation element with respect to the time reference of the sub-presentation. 



7. A method according to Claim 1, wherein the play-out specification includes a 

location specification specifying a location of the presentation element when presented and 
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wherein the interface of the sub-presentation provides a location frame of reference relative to 
which the location specification for the presentation element is specified. 

8. A method according to Claim 1, wherein the interface of the sub-presentation 
5 provides a sub-presentation priority specifying a priority with respect to presenting the sub- 
presentation. 

9. A method for playing out a coded presentation comprising at least one 
presentation element, in which method the presentation element is played out according to a 

10 play-out specification, characterized in 

that the presentation comprises a sub-presentation which comprises the presentation element, 
that the sub-presentation comprises an interface providing a reference, and 
that the presentation element is played out according to the play-out specification relative to 
this reference. 

15 

10. An apparatus for playing out a coded presentation, according to the method of 
Claim 9. 

11. An apparatus compdsing a converter module for amending a coded 
20 presentation, the coded presentation comprising: 

at least one presentation element, and 
a play-out specification of the presentation element, 
characterized in 

that the coded presentation comprises a sub-presentation which comprises the presentation 
25 element, 

that the sub-presentation comprises an interface providing a reference for the play-out 
specification of the presentation element, and 

that the converter module is arranged to substitute the sub-presentation by a fiirther sub- 
presentation comprising a corresponding interface. 

30 

12. An information carrier comprising a coded presentation, coded according to the 
method of any of the Claims 1 to 8. 




o 



2/5 




3/5 




FIG. 3 



504 



\ 



Txri 



IXT2 ^ 



TXTS 




FIG. 4 



502 



T)cri 


^508 














VIDE01 


(30,0) 5 


TXT2 


^510 






( 






- 500 


--504 




VIDEO 




TXT3 


--512 








(30,80) 










VIDEO? 




T)(T 

1 




m\ 


^514 




--506 


) 

520 



FIG. 5 



5/5 





DECLARATION and POWER OF ATTORNEY 



ATTORNEY'S DOCKET NO.: 

PHN 16.695 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first joint inventor (if 
plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled 
"Method for coding a presentation" 
the specification of which (check one) 

□ is attached hereto. 

□ was filed on as Application Serial No. and was amended on _ 



(if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including thie clauns, 
as amended by die amendment(s) referred to above. 

I acknowledge the duty to disclose information which is material to the examination of this application in accordance with 
Title 37, Code of Federal Regulations, § 1.56(a). 

I hereby claim foreign priority benefits imder Title 35, United States Code, § 119 of any foreign application(s) for patent 
or inventor's certificate listed below and have also identified below any foreign application for patent or inventor's certificate 
having a filing date before that of the application on which priority is claimed: 
PRIOR FOREIGN APPLICATION(S) 



COUNTRY 


APP.NUMBER 


DATE OF FILING 
(DATE,MONTH, YEAR) 


PRIORITY 

CLAIMED UNDER 35 
U.S.C. 119 


Europe 


97203337.7 


30 October 1997 


YES 


Europe 


97203895.4 


11 December 1997 


YES 



ii®far as the subject matter of each of the claims of this application is not disclosed in the prior United States application in the 
n^ner provided by the first paragraph of Title 35 United States Code, §112, I acknowledge the duty to disclose material 
iijdrmation as defined in Tide 37, Code of Federal Regulations, §l,5,6(a) which occurred between the filing date of the prior 
ailAication and the national or PCT international filing date of this application: 

PRIOR UNITED STATES APPLICATION(S) 



APPLICATION SERIAL NUMBER 


FILING DATE 


STATUS (PATENTED, PENDING, 
ABANDONED) 


i'y 













I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
ii|fi^rmation and belief are believed to be true; and further that these statements were made with the knowledge that willful false 
sl^iements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Tide 18 of the United 
Stlies Code and that such willfiil false statements may jeopardize the v^idity of the application or any patent issued thereon. 

I^WER OF ATTORNEY: As a named inventor, I hereby appoint the following attomey(s) and/or agent(s) to prosecute this 
a||lication and transact all business in the Patent and Trademark Office connected therewith, (list name and registration number) 

Algy Tamoshunas, Reg. No. 27,677 
" ' " " ' " " . 26,902 



SEND CORRESPONDENCE TO: Corporate Patent C 
U.S. Philips Corporation; 580 White Plains Road; 
Tarrytown, NY 10591 


Counsel; 


DIRECT TELEPHONE CALLS TO: 
(name and telephone No.) 
(914) 332-0222 


Dated: 


Inventor 


's Signature: 


Full Name of 
Inventor 


Last Name TEN KATE 


First Name Warner 


Middle Name R.T. 


Residence & 
Citizenship 


City Eindhoven 


State or Foreign Country 
The Netherlands 


Country of Citizenship 
The Netherlands 


Post Office 
Address 


Street Prof. Holstlaan 6 


City 

5656 AA Eindhoven 


State or Country 
The Netherlands 


Zip Code 


Dated: 


Inventor's Signature: 


Full Name of 
Inventor 


Last Name 


First Name 


Middle Name 


Residence & 
Citizenship 


City 


State or Foreign Covmtry 


Country of Citizenship 


Post Office 
Address 


Street 


City 


State or Coimtry 


Zip Code 



